ABSTRACT
Purpose@#Seoul National University College of Medicine operates a faculty development program for clinical teachers at multiple affiliated teaching hospitals. In 2020, the program was moved online due to coronavirus disease 2019. The purpose of this study was to determine whether it is feasible and effective to provide faculty development programs online in terms of clinical teachers’ participation and satisfaction in comparison with offline programs. @*Methods@#Clinical teachers participated in the clinical teaching methods programs offline in 2019 and online in 2020. We analyzed participation rate and satisfaction level. All surveys items were rated on a 5-point Likert scale. We also interviewed instructors about the advantages and drawbacks of the online program. @*Results@#The participation rate of the online program (89.5%) was significantly higher than that of the offline program (67.8%). The overall satisfaction level for the online program (4.37) was similar to that for the offline program (4.50). @*Conclusion@#Faculty development programs online are feasible and effective in medical education. We need to design training content that fits online programs, consider various online training methods to reinforce the strengths of online programs, and support participants to make good use of these programs.
ABSTRACT
Purpose@#Seoul National University College of Medicine operates a faculty development program for clinical teachers at multiple affiliated teaching hospitals. In 2020, the program was moved online due to coronavirus disease 2019. The purpose of this study was to determine whether it is feasible and effective to provide faculty development programs online in terms of clinical teachers’ participation and satisfaction in comparison with offline programs. @*Methods@#Clinical teachers participated in the clinical teaching methods programs offline in 2019 and online in 2020. We analyzed participation rate and satisfaction level. All surveys items were rated on a 5-point Likert scale. We also interviewed instructors about the advantages and drawbacks of the online program. @*Results@#The participation rate of the online program (89.5%) was significantly higher than that of the offline program (67.8%). The overall satisfaction level for the online program (4.37) was similar to that for the offline program (4.50). @*Conclusion@#Faculty development programs online are feasible and effective in medical education. We need to design training content that fits online programs, consider various online training methods to reinforce the strengths of online programs, and support participants to make good use of these programs.
ABSTRACT
Purpose@#The aim of this study was to evaluate the feasibility and satisfaction of an online global health education course for medical students in comparison with an in-person of the course and to assess students’ preferences regarding online methods of delivery. @*Methods@#Second-year medical students enrolled in this course in 2019 (in-person) and 2020 (online). The attendance rate, satisfaction in the course evaluation survey, and academic achievement on the written final examination were utilized to compare the two different methods of course delivery. The medical students who took the online course were also asked about their preferences regarding the method of course delivery and the advantages and drawbacks of each method of online lectures. @*Results@#There was no significant difference in the attendance rate and overall satisfaction between the two groups. The mean score on the written examination of the online course (84.1±19.6) showed comparable effects to the in-person course (78.0±18.3). The percentages of students who achieved high performance (55.5%) and the achieved minimum requirement (95.9%) were also maintained compared to the in-person course (14.6% and 93.6%, respectively). Medical students preferred the online course to the in-person course; in particular, they preferred prerecorded videos over live streaming online lectures. @*Conclusion@#The participation, satisfaction, and the academic achievement of the online course were comparable to those of the in-person course. However, the greatest drawback of the online course was the lack of interaction between peer learners. Therefore, diverse methods for online education should be considered to increase students’ sense of belonging to a learning community.
ABSTRACT
Background@#Longitudinal integrated clerkships (LICs) have been adopted by medical schools to overcome the limitations of traditional block clerkship rotations and to promote continuity of care. In 2018, Seoul National University College of Medicine introduced a patient-centered LIC program as part of a new curriculum in parallel with traditional block rotation clerkships. The purpose of this study was to present the patient-centered LIC program and to investigate its educational effects. @*Methods@#In 2018 and 2019, a total of 298 third-year medical students participated in the LIC program. We divided the students into groups of eight, which were organized into corresponding discussion classes. Throughout the academic year, students followed up patients by interviewing them at the hospital or reviewing their electric medical records.Discussion classes on set topics were held seven times per year with facilitators and clinical faculties. Students completed a course evaluation questionnaire at the end of the academic year. The questionnaire included 22 items measured on a 5-point scale and two open-ended questions asking about the benefits and limitations of the program. The items covered three domains: student experience, satisfaction, and self-assessment. Final reflective essays were collected as both student assessments and data for qualitative analysis. @*Results@#During the study period, the overall experience of the students improved. We increased the number of faculty members and patients and decreased the number of students in each discussion class. We also provided additional feedback through an e-portfolio.Students' satisfaction changed positively. Compared to the rotational clerkship, students answered that the LIC provided additional help in learning the two core competencies.During the first 2 years of the program, the percentage of students who answered that the program was more helpful than the rotational clerkship increased from 23.7% to 46.4% for continuity of care (P < 0.001), and from 20.5% to 50.7% for patient-centered care (P < 0.001). @*Conclusion@#Our patient-centered LIC, in parallel with traditional block rotation clerkships, had a positive effect on students' experience of continuity of care and patient-centered care.
ABSTRACT
Purpose@#The aim of this study was to evaluate the feasibility and satisfaction of an online global health education course for medical students in comparison with an in-person of the course and to assess students’ preferences regarding online methods of delivery. @*Methods@#Second-year medical students enrolled in this course in 2019 (in-person) and 2020 (online). The attendance rate, satisfaction in the course evaluation survey, and academic achievement on the written final examination were utilized to compare the two different methods of course delivery. The medical students who took the online course were also asked about their preferences regarding the method of course delivery and the advantages and drawbacks of each method of online lectures. @*Results@#There was no significant difference in the attendance rate and overall satisfaction between the two groups. The mean score on the written examination of the online course (84.1±19.6) showed comparable effects to the in-person course (78.0±18.3). The percentages of students who achieved high performance (55.5%) and the achieved minimum requirement (95.9%) were also maintained compared to the in-person course (14.6% and 93.6%, respectively). Medical students preferred the online course to the in-person course; in particular, they preferred prerecorded videos over live streaming online lectures. @*Conclusion@#The participation, satisfaction, and the academic achievement of the online course were comparable to those of the in-person course. However, the greatest drawback of the online course was the lack of interaction between peer learners. Therefore, diverse methods for online education should be considered to increase students’ sense of belonging to a learning community.
ABSTRACT
Background@#Longitudinal integrated clerkships (LICs) have been adopted by medical schools to overcome the limitations of traditional block clerkship rotations and to promote continuity of care. In 2018, Seoul National University College of Medicine introduced a patient-centered LIC program as part of a new curriculum in parallel with traditional block rotation clerkships. The purpose of this study was to present the patient-centered LIC program and to investigate its educational effects. @*Methods@#In 2018 and 2019, a total of 298 third-year medical students participated in the LIC program. We divided the students into groups of eight, which were organized into corresponding discussion classes. Throughout the academic year, students followed up patients by interviewing them at the hospital or reviewing their electric medical records.Discussion classes on set topics were held seven times per year with facilitators and clinical faculties. Students completed a course evaluation questionnaire at the end of the academic year. The questionnaire included 22 items measured on a 5-point scale and two open-ended questions asking about the benefits and limitations of the program. The items covered three domains: student experience, satisfaction, and self-assessment. Final reflective essays were collected as both student assessments and data for qualitative analysis. @*Results@#During the study period, the overall experience of the students improved. We increased the number of faculty members and patients and decreased the number of students in each discussion class. We also provided additional feedback through an e-portfolio.Students' satisfaction changed positively. Compared to the rotational clerkship, students answered that the LIC provided additional help in learning the two core competencies.During the first 2 years of the program, the percentage of students who answered that the program was more helpful than the rotational clerkship increased from 23.7% to 46.4% for continuity of care (P < 0.001), and from 20.5% to 50.7% for patient-centered care (P < 0.001). @*Conclusion@#Our patient-centered LIC, in parallel with traditional block rotation clerkships, had a positive effect on students' experience of continuity of care and patient-centered care.
ABSTRACT
BACKGROUND: It is critical to develop remedial education for underperforming medical students, but little is known about how to create an effective remediation program. Deliberate practice (DP) is a structured and reflective activity that is designed to optimize performance. Here we applied the concept of DP to create remedial education to improve the clinical practices of medical students. We also analyzed the effectiveness of the remediation program. METHODS: Based on the expert performance approach of DP, we designed a 4-week remedial program for clinical performance that included feedback and reflection. There were 74 student participants in this program from 2014 to 2017. Their clinical performance was re-evaluated after completion, and changes in their clinical performance scores were analyzed. RESULTS: Students who completed the remediation program showed significant improvements in clinical performance scores (P < 0.001). Most students found the program to be instructive and helpful for improving their clinical performance. They reported that role play with peers was the most helpful for improving their skills. CONCLUSION: The DP-based remediation program improved the clinical performance of failing medical students. This remediation program should continue to be offered to underperforming students to ensure that medical school graduates are competent.
Subject(s)
Humans , Clinical Competence , Education , Education, Medical , Longitudinal Studies , Prospective Studies , Schools, Medical , Students, MedicalABSTRACT
PURPOSE: Continuing professional development is essential for improving health care services, especially in developing countries. Most of the training programs in Mongolia were not based on a targeted needs assessment. Therefore, we aimed to apply a mixed methods design to assess the training needs of Mongolian health professions. METHODS: We conducted a needs assessment using a convergent parallel mixed methods design in two steps. The survey and interview questions were developed to identify priority areas, targeted trainees, and effective training methods. A survey on 60 respondents, 15 individual interviews, and a focus group interview with 14 participants were conducted in the first step. In the second step, 12 representatives of key stakeholders were invited to a second focus group interview. RESULTS: Current health policy areas, areas related to future national plans, and areas not currently receiving governmental or international support were suggested as the main priorities. The stakeholder suggested that trainees should be selected based on their professional experience and language level, as well as each hospital’s needs. Building teams including various professions, such as nurses, technicians, and biomedical engineers, was recommended as a way to exchange ideas with each other and to build teamwork for future collaboration. CONCLUSION: Medical training needs are dynamic and complex; therefore, a deep understanding of the context and setting is necessary. In this study, we assessed the targeted training needs of Mongolian health professions through a mixed methods design, which could be an effective way to conduct needs assessments for training programs.
Subject(s)
Cooperative Behavior , Delivery of Health Care , Developing Countries , Education , Fellowships and Scholarships , Focus Groups , Health Occupations , Health Policy , Methods , Mongolia , Needs Assessment , Surveys and QuestionnairesABSTRACT
PURPOSE@#Continuing professional development is essential for improving health care services, especially in developing countries. Most of the training programs in Mongolia were not based on a targeted needs assessment. Therefore, we aimed to apply a mixed methods design to assess the training needs of Mongolian health professions.@*METHODS@#We conducted a needs assessment using a convergent parallel mixed methods design in two steps. The survey and interview questions were developed to identify priority areas, targeted trainees, and effective training methods. A survey on 60 respondents, 15 individual interviews, and a focus group interview with 14 participants were conducted in the first step. In the second step, 12 representatives of key stakeholders were invited to a second focus group interview.@*RESULTS@#Current health policy areas, areas related to future national plans, and areas not currently receiving governmental or international support were suggested as the main priorities. The stakeholder suggested that trainees should be selected based on their professional experience and language level, as well as each hospital’s needs. Building teams including various professions, such as nurses, technicians, and biomedical engineers, was recommended as a way to exchange ideas with each other and to build teamwork for future collaboration.@*CONCLUSION@#Medical training needs are dynamic and complex; therefore, a deep understanding of the context and setting is necessary. In this study, we assessed the targeted training needs of Mongolian health professions through a mixed methods design, which could be an effective way to conduct needs assessments for training programs.
ABSTRACT
PURPOSE: The introduction of community-based medical education would help improve the quality of primary care. This paper suggests learning objectives and an educational program for community-based medical education. METHODS: The educational program was developed in a 1-day consensus workshop. Twenty experts, including faculty members from family medicine department of a college of medicine in Seoul and community-based preceptors, participated in the program. A needs-assessment survey was conducted among community-based preceptors before the workshop. Through this workshop, we derived learning objectives and a standardized curriculum for community-based medical education. RESULTS: In the questionnaire before the workshop, community-based preceptors voiced concerns over the program's potential costs and the time required for teaching. The learning objectives and educational programs derived from the workshop's consensus were consistent with the characteristics of the primary care. Based on the results of this workshop, the joint expert team developed a standard educational program on two core topics: clinical teaching and mentoring. CONCLUSION: From this curriculum development process, participants could construct a more standardized curriculum for community-based medical education. Future studies are needed to evaluate the long-term outcomes of these educational programs, such as the learners' satisfaction and achievement.
Subject(s)
Humans , Consensus , Consensus Development Conferences as Topic , Curriculum , Education , Education, Medical , Joints , Korea , Learning , Mentors , Models, Educational , Preceptorship , Primary Health Care , SeoulABSTRACT
PURPOSE: This study aimed to develop a core competency model for translational medicine curriculum in the Korean graduate education context. METHODS: We invited specialists and key stakeholders to develop a consensus on a core competency model. The working group composed of 17 specialists made an initial draft of a core competency model based on the literature review. The initial draft was sent to the survey group by email to ask whether they agreed or disagreed with each core competency. The working group simplified, merged, or excluded the competencies that received less than 80% agreement among the 43 survey respondents. The working group also reorganized the order of the domains and competencies based on the survey results, and clustered the domains into four major areas. RESULTS: The final core competency model has four areas, 12 domains, and 34 core competencies. The major areas are theory-based problem assessment and formulation, study design and measurement, study implementation, and literature review and critique. CONCLUSION: This new core competency model will provide guidance for the competency based education of translational medicine in Korea.
Subject(s)
Competency-Based Education , Consensus , Curriculum , Education, Graduate , Electronic Mail , Evaluation Studies as Topic , Korea , Specialization , Surveys and Questionnaires , Translational Research, BiomedicalABSTRACT
The longitudinal integrated clerkship is an innovative approach in medical education that emphasizes continuity as a key principle to provide student-centered experiences and learning. Seoul National University College of Medicine decided to adapt longitudinal integrated clerkships to the new curriculum beginning in 2018, and therefore conducted pilot studies in 2016 and 2017. This study aimed to analyze the program evaluation results of the two pilot programs and discuss issues related to the successful implementation of longitudinal integrated clerkships in Korea. We conducted a focus group interview with nine students who participated in the 2016 pilot program and 13 students who participated in the 2017 pilot program. We also conducted a focus group interview with 11 faculty members who either participated in the pilot program or will participate in the main program. From the 2016 experience, we found that it is not appropriate to assign each patient to a single student and let the students contact their patients personally for feasibility and safety reasons. In the 2017 pilot program, we assigned each patient to a group of students, which made it more feasible for the students to follow-up with their patients. The students were satisfied with their new experience of longitudinal patient follow-up and regular meetings in the pilot program. Faculty emphasized the importance of establishing the course objectives and holding an orientation for the students and the faculty. Further study is planned to evaluate the early outcomes of the main longitudinal integrated clerkship.
Subject(s)
Humans , Curriculum , Education, Medical , Focus Groups , Follow-Up Studies , Korea , Learning , Linear Energy Transfer , Pilot Projects , Program Evaluation , SeoulABSTRACT
PURPOSE: Team-based learning (TBL) is increasingly employed in medical education because of its potential to promote active group learning. In TBL, learners are usually asked to assess the contributions of peers within their group to ensure accountability. The purpose of this study is to assess the validity and reliability of a peer evaluation instrument that was used in TBL classes in a single medical school. METHODS: A total of 141 students were divided into 18 groups in 11 TBL classes. The students were asked to evaluate their peers in the group based on evaluation criteria that were provided to them. We analyzed the comments that were written for the highest and lowest achievers to assess the validity of the peer evaluation instrument. The reliability of the instrument was assessed by examining the agreement among peer ratings within each group of students via intraclass correlation coefficient (ICC) analysis. RESULTS: Most of the students provided reasonable and understandable comments for the high and low achievers within their group, and most of those comments were compatible with the evaluation criteria. The average ICC of each group ranged from 0.390 to 0.863, and the overall average was 0.659. There was no significant difference in inter-rater reliability according to the number of members in the group or the timing of the evaluation within the course. CONCLUSION: The peer evaluation instrument that was used in the TBL classes was valid and reliable. Providing evaluation criteria and rules seemed to improve the validity and reliability of the instrument.
Subject(s)
Humans , Education, Medical , Learning , Methods , Reproducibility of Results , Schools, Medical , Social ResponsibilityABSTRACT
The main points of issue with the former premedical curriculum of Seoul National University College of Medicine (SNUCM) were the absence of educational objectives, decline in student motivation caused by uniform education, students' lack of a sense of belonging, and lack of humanistic education. In accordance with these issues, there were five aspects considered for the improvement of the premedical curriculum: reform based on the newly established educational objectives that corresponds with the 6-year medical school curriculum as a whole, expansion of elective courses and the development of personalized curriculum for the improvement of students' learning motives, expansion of social sciences and humanities curriculum for the development of students' capabilities as good doctors, active participation of medical professors in premedical education, and expansion of informal education and the student support program. According to the assessment done after the implementation of the reformed curriculum, premedical students were gratified with its establishment and management of multifarious liberal arts and major subjects. In preparation of the more rigorous entrance quota of the premedical school at SNUCM, there is ongoing reform of required major subjects and establishment of new subjects in the premedical curriculum in pursuit of unity with the 6-year medical curriculum. Moreover, there is ongoing development of an e-portfolio system for the association of premedical and medical education, integration of formal and informal curriculum, and reinforcement of student observation and formative evaluation. Further discussion on the assessment and betterment of premedical curriculum is needed.
Subject(s)
Humans , Clothing , Curriculum , Education , Education, Medical , Education, Premedical , Humanities , Learning , Motivation , Schools, Medical , Seoul , Social Sciences , Students, PremedicalABSTRACT
PURPOSE: The Mongolian National University of Medical Sciences is the only national university in Mongolia and has produced more than 90% of health professionals in the country. Experts from Mongolia and Korea embarked on a collaborative effort to develop educational programs for faculty development based on the personal and professional needs of faculty members. This study aimed to evaluate the outcomes of those educational programs to determine whether this transnational collaboration was successful. METHODS: A needs assessment survey was conducted among 325 faculty members. Based on the results of this survey, the joint expert team developed educational programs on seven core topics: clinical teaching, curriculum development, e-learning, item writing, medical research, organizational culture, and resident selection. Surveys evaluating the satisfaction and the attitudes of the participants were conducted for each program. RESULTS: Throughout the 17-day program, 16 experts from Korea and 14 faculty members from Mongolia participated as instructors, and a total of 309 participants attended the program. The average satisfaction score was 7.15 out of 8.0, and the attitudes of the participants towards relevant competencies significantly improved after each educational program. CONCLUSION: The faculty development programs that were developed and implemented as part of this transnational collaboration between Mongolia and Korea are expected to contribute to the further improvement of health professions education in Mongolia. Future studies are needed to evaluate the long-term outcomes of these educational programs.
Subject(s)
Humans , Cooperative Behavior , Curriculum , Education , Health Occupations , Joints , Korea , Medical Writing , Mongolia , Needs Assessment , Organizational CultureABSTRACT
PURPOSE: Medical professionals from Korea and Laos have been working together to develop a continuing professional development training program covering the major clinical fields of primary care. This study aimed to evaluate the effectiveness of the program from 2013 to 2014 using the Kirkpatrick model. METHODS: A questionnaire was used to evaluate the reaction of the trainees, and the trainers assessed the level of trainees' performance at the beginning and the end of each clinical section. The transfer (behavioral change) of the trainees was evaluated through the review of medical records written by the trainees before and after the training program. RESULTS: The trainees were satisfied with the training program, for which the average score was 4.48 out of 5.0. The average score of the trainees' performance at the beginning was 2.39 out of 5.0, and rose to 3.88 at the end of each section. The average score of the medical records written before the training was 2.92 out of 5.0, and it rose to 3.34 after the training. The number of patient visits to the district hospitals increased. CONCLUSION: The continuing professional development training program, which was planned and implemented with the full engagement and responsibility of Lao health professionals, proved to be effective.
Subject(s)
Humans , Education , Health Occupations , Hospitals, District , Korea , Laos , Medical Records , Physician Assistants , Primary Health Care , Program EvaluationABSTRACT
PURPOSE: The purpose of this study was to develop criteria to evaluate a premedical curriculum to ultimately improve the quality of premedical education. METHODS: The first draft of the evaluation criteria was developed through a literature review and expert consultation. The Delphi survey was conducted to ensure the validity of the draft. RESULTS: The final premedical curriculum criteria consisted of three evaluation areas (curriculum development, curriculum implementation, and curriculum outcome), five evaluation items (educational objective, organization of curriculum, instructional method, class management, and educational outcome), and 18 evaluation indicators. CONCLUSION: There should be further discussion on the evaluation questionnaire and the content for each evaluation indicator with regard to its practical application. Also, a concrete evaluation system, including evaluation standards and rating scales, should be developed.
Subject(s)
Humans , Curriculum/standards , Delphi Technique , Education, Premedical/standards , Program Evaluation/methods , Reproducibility of ResultsABSTRACT
This study aimed to evaluate the effect of the formative program evaluation on the continuous improvement of a clinical training program for Lao health professionals. The training program was conducted 4 times consecutively for total 48 health professionals, and the formative program evaluation was carried out during the whole process. To evaluate the satisfaction and the transfer of the trainees, the questionnaire survey, the focus group interview, and the trainees' medical records were used. After the end of each batch of the program, the evaluation data were analyzed, and its results were shared with the training management committee and the trainers, who, based on the results, reached a consensus on how to improve the program. The evaluation results and the comparison of them among the four batches of the program showed that there was a continuous increase of the satisfaction and the transfer of the trainees, especially in the early period of the program. The formative program evaluation which was conducted during the whole process of the clinical training program had a positive effect on the improvement of the program, especially in the early phase, by increasing the satisfaction and transfer of the trainees.
Subject(s)
Humans , Education, Continuing , Health Personnel/education , Laos , Program EvaluationABSTRACT
PURPOSE: Seoul National University College of Medicine (SNUMC) introduced a multiple mini-interview (MMI) to assess the noncognitive ability of applicants in 2013. This study aims to examine whether students differ with regard to their personal career values and academic achievements by admission type. METHODS: We administered a survey about career values and self-perception of competencies. We then compared the survey results and academic achievements by admission type. Finally, the correlation coefficient between MMI score and academic achievement was calculated in the MMI group. The data were analyzed by t-test and correlation analysis. RESULTS: There was no statistically significant difference in career values between groups. For self-perception of competency, only the 'interact in heterogeneous groups' domain was higher for those who entered through the MMI. The MMI group had a higher and broader level of academic achievement. Within the MMI group, there was a significant correlation between grade point average and MMI station scores. CONCLUSION: The characteristics of students who entered through the MMI were more in accordance with the goals of SNUMC and the competency of future doctors. Considering the unique feature of premedical academic achievement, this result implies that such students have superior noncognitive abilities, such as self-development and internal motivation. How these differences change subsequently remains to be seen.
Subject(s)
Humans , Motivation , Schools, Medical , Self Concept , Seoul , Students, PremedicalABSTRACT
PURPOSE: The Lee Jong-Wook Seoul Project, which began in 2011, is a training program that aims to educate faculty members of Lao University of Health Sciences in medical knowledge and skills. The project has tremendous significance, attempting to apply the Korean health care developmental model to developing countries. Precise evaluation of the project outcome must be performed to enhance the effectiveness, improve the shortcomings, and adjust the future direction of the program. METHODS: Trainers and exchange professors were asked to fill out questionnaires in the middle and at the end of the program. Eight months after its completion, an evaluation team visited Lao and interviewed each exchange professor individually. Also, 360-degree feedback was obtained from their colleagues. We analyzed the answers to the questionnaires, based on Kirkpatrick's 4-level model. RESULTS: The trainers and exchange professors had positive reactions to the program. All participants felt that their knowledge and skills improved (in their respective fields), although the actual improvement was not extensive, according to their trainers' assessments. The 360-degree feedback demonstrated that the participants actively passed on their experience, knowledge, and skills to their colleagues on returning to work. CONCLUSION: Although a 4-level evaluation was not conducted and despite the limitations in examining academic achievement, interviewing Lao professors, and acquiring quantitative data at Lao University of Health Sciences, this project has demonstrated its value in the development of individual professors and their colleagues.